MS1-634US 



r- 102 
Source 1 



Prior Art 



104 



Source 
Filter 



106 



H 



Splitter 
Filter 



Transform 
Filter A 



110 



Transform 
Filter B 



100 




Application Program(s) 




COM ^ 302 
Interfaces 



216 



300 



222 



304A 



306A 



Source 
Filter 



Transform 
Filter(s) 



Render Engine 
^308 



Source 
Filter 



Transform 
Fjlter(s) 



304N^ 306N 



Dynamic Matrix 
Switch Filter 



306B 



Transform 
Filter(s) 



Transform - 
Filter(s) 



310 



Render 
Filter 



h306C 



From Source (file, AA/ tape, AA/ device.antenna, etc.) 
From Source (file, AA/ tape, AA/ device, antenna, etc.) 



To Hardware 
Renderer 



MS1-634US 




MS1-634US 



402< 



410 



4 



Media Time 



Input 0 



Matrix Switch 



Matrix Switch 
Programming Grid 



Input N 



412 



Input/Output 
Buffer(s) 



Project Time 



Output 0 
406 

-408 



Output N 



308 



>404 







A B 








© 



Tx 



MS1-634US 



o 
o 

CD 



CD 
O 



CD 
O 



i 



CD 
CL 

CO 

c 
o 

t3 

CD 
C 

c 
o 

.E E 

CL <^ 



13 
O 

O) 

c 

C 

o 

Q. 

o 

O 



e 

CL 



O ^ CO 



O 
LO 



CD 




C 








de 


CD 


c 


E 






IT 





CO 

o 

CO 



CD 



o 

CN 
CD 



CO ^ 



O CD 
^ LL 



CM 
CM 
CD 



If o 



CX) 
S 



CD 



CD 



O 
CO 
CL 



O 



CD 



<3> ^ 
CO 



CD 









0 






O 




FR 


Pack 


C 


\ 


9Z! 


CD 






Re 





CD 







ode 


CD 


o 






E 


Q 





S 0) 



S 05 



6 



CD 






0 






O 


E 


CO 





MS1-634US 



7 

StartJ 



702 



Receive a request to generate media 
processing project utilizing resources 
of filter graph generator 



Identify nunnber of media sources 
selected by user 



704 



706 



Identify required source, transform 
and rendering filter(s) to effect 
processing project 



Based on user editing instructions, 
filter graph manager establishes a 
programming grid for matrix switch 
filter, identifying which inputs are to 
be coupled to which outputs at 
particular project times 



/ 



-708 



Based, at least in part, on the 
programming grid, filter graph 
generator establishes a matrix switch 
filter and assembles the filter graph 



710 



Filters (re)negotiate buffer memory 
requirements between filters 



712 



Execute media processing project on 
demand 



714 



MS1-634US 



802 



804 



Matrix switch notes the maximum 
buffer requirements for any object 
coupled to any of its inputs/outputs 



Negotiate buffer size and attribute 
characteristics for buffers between 
I/O 



712 



Matrix switch connects all of its I/O to 
806 adjacent objects with the new buffer 
requirements, attempting to be the 
allocator in all of its pin connections 



No 



810 



Buffer copy operations 
will need to be performed 
from input(s) to output(s) 
for I/O which switch is not 
allocator 



808 

Allocator for all I/O? 




Yes 



812 



Restore connections in remaining 
filters using negotiated buffer 
requirements 




MS1-634US 



^900 

User-defined 
Editing Project 



^910 

Data Structure 
jnJ representing 
Project, e.g. a 
tree 



902 ^904 906 



Source ) Trans, 



\ 



908 




/ 



A 
/ \ 
/ \ 
/ \ 
/ \ 
/ \ 



.^912 

Data Structure 

Utilized to 
Program Matrix 
Switch, e.g. grid 



/ \ 
/ \ 
/ \ 



" A 


0 




B 




0 


1 




C 




2 


0 


T 




0 





i\me 0 



6 



8 



908 



10 



12 



14 



16 



B 



T 



MS1-634US 




MS1-634US 



1300 



0 2 4 6 8 10 12 14 16 



A 



0 



1300 



0 2 4 6 8 10 12 14 16 



A 
B 



0 






0 





1300 



0 2 4 6 8 10 12 14 16 



A 


0 




B 




0 




C 




0 



1300 



0 2 4 6 8 10 12 14 16 



A 


0 




B 




0 




C 




0 


Trans 




0 





MS1-634US 



1300 



0 2 4 6 8 10 12 14 16 



A 


0 




B 




0 


[0]1 




C 




[0]2 


0 


Trans 




0 





'Pi^. t7 



1300 



0 2 4 6 8 10 12 14 16 



(0) A 


0 


v////m. 




(1) B 




0 


[0]1 




(2) C 




[0]2 


0 


(3) Trans 




0 





MS1-634US 



1900 -^ 


( \ 

Provide a matrix switch 




\ 




1902 


f \ 

Define a first data structure that represents 
an editing project 








1904 


Process first data structure to provide a 
second data structure configured to 
program the matrix switch 






r 


1906 


Program matrix switch using second data 
structure 



MS1-634US 



time 0 2 4 6 8 



A 



B 

Effect 



2000^ 




MS1-634US 



2200 



0 2 4 6 8 10 12 14 16 



A 


0 




B 




[0]1 




Fx 




0 





2200 



0 2 4 6 8 10 12 14 16 



(0) A 


0 




(1) B 




[0]1 




(2) Fx 




0 


[0]2 




(3) C 




[0]3 


0 


(4) T 




0 






MS1-634US 




MS1-634US 



2700 



2702 



(10) A 

(11) B 

(12) C 

(13) D 

(14) E 

(15) Mix 



////////// 


///>//////////////////////////// 
[0]3 


[0]4 








[0]5 




[0]6 




[0]7 


0 



A 
B 
C 
D 
E 



Matrix Switch 



10 - 

11 - 

12 ■ 

13 ■ 

14 ■ 

15 



0 



3 
4 

-► 5 

6 

-► 7 



Mix 



MS1-634US 




MS1-634US 




MS1-634US 





3100 



0 2 4 6 8 10 12 14 16 



(0) A 

(1) / B 

(2) I C 

(3) \t2 

(4) T1 



0 


3 






4 


0 


1 






2 


0 




0 






0 





MS1-634US 



A 
B 
C 



Matrix Switch 

0 
1 
2 
3 
4 



1 
2 

3 
4 



T2 



T1 



3900 



3902 



3904 



Define a multimedia editing project to 
include at least one composite that 
represents multiple tracks as a single track 



Define a first data structure that represents 
the editing project 



Process first data structure to provide a 
second data structure configured to 
program a matrix switch 



7^ 



3906 -A Program matrix switch using second data 

structure 



MS1-634US 



Start 



4002 



Receive indication to generate 
development project 



4004 



Identify all sources utilized in development 
project, and when they are required. 



I 



4006 



Generate and manage filter graph utilizing 
only those chains for sources which are 
necessary to support current execution of 
the filter graph 



I 



End 



MS1-634US 



u 
m 

m 
a 
m 

iii 

Q 

m 
m 

a 
M 



o 
o 



00 

o 



CO 

o 



CO 

'o 
c 

CD 
"O 

c 

CD 
Cl 
CD 

Q 



0 
E 
i- 

CD 

o 



CD 

E 

i- 

CD 
CL 



O 



CM 

o- 



CD 

O 
CO 



g 

c 

"co 
x: 

O 



CD 

o 



o 

CO 

oi 

CN 

o 

I 

o 
d 

CD 

d 



> 

CO 

■> 

o 

E 



o 



CO 

i6 

CO 

d 



in 

CO 

CN] 

6 

CO 

CN 
CM 



> 
CO 

csi 
0 

> 
o 

E 



A 
CO 

CO 

-o 

V 



A 
CO 

-4-' 

CO 
■D 

V 



CNJ 




00 


O 


o 


o 


CO 


CO 


CO 









A 

CO 
-t-» 
CO 
■D 

V 



A 
CO 

CO 
"D 

V 



CM 



MS1-634US 



From 4004 



4006 



I 



Identify chain(s) required in the next M 
seconds 



4202 



Y 



4204 
'Chain-count<T 



Load ciiain(s) 



4206 




4208 



Identify currently loaded 
chain(s) that will not be used 
in the next N seconds 



4210 




B 



Unload identified 
thread(s) 




MS1-634US 







C 








de 




c 













o 
o 

CO 



C\r\ 



CN 
O 
CO 




















LU 





'♦-J .'t: 

CO > = 



0 





i— 






025 




O 


iZ 


01 


o 


LL 


CO 




CL 




<i5 «_ 

o il 
CO 




• • • 







C 








de 


0 


c 




<D 









CO , 
O 0 

LU 









0 






iU 


E 




o 




CO 




CL 






ize i 


0 


> 


! (/) 






\ Re 


E 





CX3 
O 
CO 




